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Given a scene, as seen for instance from A T*V* camera or a 
picture, it is desired to analyze it to recognise* differentiate 
and identify desired objects ox classes of objects {1 r C., patterns) 
in it. 


The present report describes a program* written in CONVERT, 
which partially soblevaa this goal. Two inputs to the program 
determine its bebavioT and reaponset 

1„ The scana to ba analysed* which is entered in a 

Symbolic format (it may contain ^-dimensional and 
curved objects). 

2, A symbolic description — called the model — of 

the class &f the objects we want to identify in the 
scene (1)t 

Given a aet of models of the objects we want to locate,, and a scene 
or picture, the program will identify in it all those objects or 
figures which are similar to one of the modelE, provided they appear 
complete in the picture {i.e.j, no partial occlusion or hidden parts)* 
Recognition is independent of position, orientation, size etc.; it 
Strongly depends on the topology of the model. 

Important restrictions and suppositions arei (a) the input is 
assumed perfect — noiseless— and highly organised; (b) more than 
one model is in general required for the description of one object 
and (c) only objects which appear unobstructed Are recognized . 

Work is continuing in order to drop restriction (c) and to 
improve (a). 
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SUMMARY 

The FrobJem- 

A picture, scene or vinw, is read with the help of an optical 
device and stared as an array of light intensities in the memory 
□f the computer. The ultimate goal will be to understand this 
information, that la, to identify, separate and position the 
different objects or bodies belonging to the scene(•) , The 
deeLanda of infooiation will vary: som&tImes we will he Interested 
in knowing if object A is seen in the scene or not; while at other 
Claes we say require a complete description of the scene, including 
information on relative support and {3-d) position of the different 
components. Hence it is clear that the recognizer will need an 
additional Input to Specify the nature of the question that the 
program is to answer by analyzing the scene. 

The Proposed Solution, 

During the steamer of 1966 this general problem was attacked 
(1) by a group of people, the so-called Vision Group, with results 
reported here and elsewhere^ fhe work here described is only a 
part of the total effort, as we will see below„ We divide the 
systeel; in two phases i " Pr&prnceasing ” and '' recognition 11 . 

Preprocessing - program (6) sweeps the array containing the scene 
and collects sots of points satisfying a given predicate; these 
sets arc called regions , and roughly correspond to the different 
faces of the objects. Thus, in Fig, "EXAMPLE”, some regions are 

A,S,C.L,^h It is entirely possible* but it is undesirable, 

that two or more regions will be reported as one, for instance, 

A and £ (ef. Fig. "EXAMPLE") could be repotted as f > -—J : 
similarly, depending on the chosen predicate, the long region D 
could be reported as two shorter ones, if the predicate were "equel 
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TIG, 1 EXAMPLE r - A scene, 

Another program not yet debugged will drive the reglon-findar, 
supplying 'good 1 eradicates; the boundaries will be sorted and 
''smoothed' 1 , and the bad regions eliminated and/or merged. 

A further preprocessing Is (or wilL he) then done^ 3 ^' 
interpolating straight lines, segments of curves, etc., until 
finally each region is (or ■will be) described by a set of properties 
for instance, in Fig. T EXAMPLE- r , 

Region A will be; 

NEIGHBORS C h B* Z 
CENTER (10, 27.5) 

SHAPE (\ , / ,\ h / ) 

Tills input is the one which the recognizer uses. 

It is understood that finding properly meaningful regions is 
non-trivia1 and that a£ the System develops ve expect this part tP 
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bacftme niftfe involved with feedback from the Viigbe.r-le.vel recognition 
pro grams, 

Model, - This is a description, in 
a particular symbolic format, of on 
object, Models represent objects 
regardless of position, shape, 
orientation., etc., unless specif¬ 
ically Specified otherwise. Tor 
instance, the model "PARALLELEPIPED* 
in figure ' PARALLELEPIPED 1 is 
wxittOfl as: 

FIG, h PARALLELEPIPED 1 , A Model. 

((A* (NEIGHBOR £*) 

(NEIGHBOR C*) 

(011 ATE PARALLELOGRAM) > 

(B* (NEIGHBOR A*) 

(NEIGHBOR. C*> 

(SHAPE PARALLELOGRAM)) 

(C+ (NEIGHBOR A*) 

(NEIGHBOR E*) 

(SHAPE PARALLELOGRAM)) ) 

A model is composed of regions, with properties? inter-rel.itlog them. 
Given an object, there is a large number of models which correctly 
describe It. 

Recognition . - This report describes the recognizer, i,e. T a program 
which, given a scene ( such as- ’EXAMPLE^) and a model (such OS 
K PARALLELEPIPED'), will identify all parallelepipeds 6 present in 
N exapsple2 1 , In this case, parallelepipeds 1 and 3 are found, 
parallelepiped 2 is parially hidden and is not recognized. Both the 
scene and the model are in symbolic format. 
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FLG* 1 EXAHPLE2 t + Three parallelepipeds. 

Restrictions: In this £irgt experimental ayatec; we will live 
with the following constraints: 

1, Noiseless data is supposed, i.e,, the scene BUdt he accurately 
described by its symbolic r up res ent ation ■* Also, the set of 
shapes nssumed is small, so that we need not worry about heuristic 
efficiency in algorithms. 

2 # Whenever a S^dimenaional object gives rise to several (2-dim) 
projections which are topologically different, sLl these need 
to be presented as models in order to cover the possible cases* 

Tie recognizer has an OR feature for this effect, For instance* 
Fig, ‘L* has the game object in four different positions* requiring 
3 ot possibly 4 modela of an r L' to identify all. The exact number 
depends on the particular models in question and their ’’don r t”cave n 
conditions, which may depend on what Othnr objects in the world 
have to be distinguished, 

3. Only objects which are totally seen are recognised* Partially 
occluded, or hidden parts or bodies nay he present in the picture 
but the occulted objects will not be identified. For instance, 
parallelepiped 2 f.n fig^ 1 EXA.MPLE2 1 waa not found. Our current 
work will help to relax thig last restriction, and also restriction 
(1),. The reader unfamiliar with progress In that direction man 
see Refs, {10) for some earlier work of that kind. 



The sane object in four different 
positions, all of which differ in 
the topology of its two dimensional 
projection over the plane of the 
drawing. 


4. In the present program we assume orthogonal projections. Later 
lfft will consider finite perspective. For smell visual angles* 
a simple tolerance should suffice for most casts* but for large 
visual angles we will have to use other methods. 


TEE SCE^E 

Informally, a scene (picture) is a collection of regions,(pTojfictions 
of fac&s); a region is described by an ordered collection of segments 
(lines ox curve a) s and these have several properties. 

A scene is represented by an atom which has under the entry 'REGIONS 1 
a list of the regions composing it; for instance (sc® fig. 'BOTTLES 1 1 s 
the atom BOTTLES is a scene for which 

(GET (QUOTE BOTTLES) (QUOTE REGIONS)) = {ASCDEFUHIJKLKZ) 
In this ease the regions of ’bottles 1 are A n E,, 





A region Is an atom which has in its property List the entries 
SHAPE, and possibly others. A region correspond! to a surface 
in the scene, except tliat it is treated £-dimensionally; i.e., 
F EXA>IFLE2', the upper face of the eraser A E C E L is composed 
regions, namely B and L. 


NEIGHBOR, 
or face 
in fig. 
of 2 


PCEICHBOR (L Z) {L and Z are limitrophe regions with M) 

&MARE ELLIPSE 

At present, the shapes of regions can only be Atoms; this is a severe 
restriction since it may be too much to require that the preprocessor 
recognize region M (fig. r CATTLE5") AS Ah ellipse or region A (fig. 

’EXAMPLE 1 ) as a parallelogram. In tha modela, the shapes arc also 
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a coins. This restriction will be abandoned, eventually, but new ie 
o b s CTved - 

Complete example of a Scene.. - The scene 'GREEN' (see fig, 1 GREEK 1 } 
is entered into memory as follows: 


(DEFF10P A {B C til) NEIGHBOR) 
(DEFFROP R (A C Ml) NEIGHBOR) 
(DEFFROP C {A E Ml) NEIGHBOR) 
(DEFPROP D (E Ml) NEIGHBOR) 
(DEFFROP K (D Ml) NEIGHBOR) 
(DEFFROP F {G I J H Ml)NEIGHBOR) 
(DEFFROP C {F I H Ml)NEIGHBOR) 
(DEFPROP H (F G Ml) NEIGHBOR) 
(DEFPBQP I (F G J Hi)NEIGHBOR) 
(DEFFROP J (F I HI) NEIGHBOR) 
{DEFPROP K (M ML) NEIGHBOR) 
{DEFFROP L (N H Ml) NEIGHBOR) 
(DEFFROP M (L N HI) NEIGHBOR) 
{DEFFROP N (0 F L H K Ml)NEIGHBOR) 
{DEFFROP 0 (P N Ml) NEIGHBOR) 
{DEFFROP ? (HO) NEIGHBOR) 
(DEFPROP (J (S TS Ml) NEIGHBOR) 
(DEFPROP R {[) $ Ml) NEIGHBOR) 
(DEFFROP S (Q R T Ml)NEIGHBOR) 
{DEFFROP T {q S Ml) NEIGHBOR) 
{DEFFROP W {V X BI Ml)NEIGHBOR) 
(DEFFROP V (Bl U ML)NE1GHE0R) 
{DEFFROP V (X Bl MI)NEIGHBOR) 
{DEFFROP X (V NT Bl Ml) NEIGH BOR) 
(DEFFROP 2 (EL Ml) NEIGHBOR) 
(DEFFROP AL (EL ML) NEIGHBOR) 


(DEFFROP Bl (A1 V U X U Z) NEIGHBOR) 
(DEFFROP Cl (El FI G1 D1 Ml)NEIGHBOR) 
{DEFFROP PI (Cl FI El Gl HI)NEIGHBOR) 
{DEFFROP El (ML Cl FI Dp NEIGHBOR) 


(BEFPROP FI (Cl DI EL) NEIGHBOR) 
{DEPPHOP G1 (CL DI Ml) NEIGHBOR) 
(DEFFROP HI (II ML) NEIGHBOR) 
(DEFFROP IL (HI KL Ml) NEIGHBOR) 
(DEFFROP £1 (11 ML) NEIGHBOR) 


(DEFFROP A PENTAGON SHAPE) 
(DEFFROP B PARALLELOGRAM SHAPE) 
(DEFFROP C PARALLELOGRAM SHAPE) 
(DEFFROP D (I G I D) SHAPE) 
(l)EFPROP E ELLIPSE SHAPE 
(DEFFROP F ELE SHAPE) 

(DEFFROP G PARALLELOGRAM SH^FF) 
(DEFFROF H PARALLELOGRAM SHAPE) 
(DEFFROP I PARALLELOGRAM SHAPE) 
(DEFFROP J PARALLELOGRAM SHAPE) 
(DEFFROP K SPHERE SHAPE) 
(DEFFROP L TRIAHGE SHAPE) 
(DEFFROP 'i TRIANGLE SHAPE) 
(DEFFROP N FLfflHI SHAPE) 

(DEFFROP 0 PARALLELOGRAM SHAPE) 
(DEFFROP P PARALLELOGRAM SHAPE) 
(DEFFROP Q FENTAGON SHAPE) 
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(LEFPROP 

R 

PARALLELOGRAM SHAPE) 

(DEFPROP 

B1 

CROSS SHAPE) 

(DEFPROP 

S 

PARALLELOGRAM SHAPE) 

(LEFPROP 

Cl 

PENTAGON SHAPE) 

(DEFPROP 

T 

PARALLELOGRAM SHAPE) 

(PEFFKOP 

D1 

FENTAG0N SHAPE) 

(DEFPROP 

U 

PARALLELOGRAM SHAPE) 

(DEFPROP 

El 

FUNNY SHAPE) 

(DEFPROP 

V 

PARALLELOGRAM SHAFE) 

(DEFPROF 

FI 

QUADRILATERAL SHAPE) 

(DEFPROP 

w 

PARALLELOGRAM SHAPE) 

(DEFPROP 

Gl 

QUADRILATERAL SHAPE) 

(OEFPROP 

A 

PARALLELOGRAM SHAPE) 

(DEFPROP 

HI 

(ICID) SHAPE) 

(DEFPROP 

z 

TRAPEZIUM SHAPE) 

(DEFPROP 

11 

(ELLIPSE IMSIDE ELLIPSE)SHAPE) 

(LEFPROP 

Al 

TRAPEZIUM SHAPE) 

(DEFPROP 

El 

FUNNY SHAPE) 


THE MODEL 

A model is an aCoe which contains in its property list, under the 
On tty 1 REGIONS', a liat of the following form; 

a) the 1st. element of such a list is an at ora > the name of the region 

as far as tha sn>del is concerned 

b) each of the remaining elements of such a list is a property; 

Speed£1tally„ is either a list (NEIGHBOR <<) 

or a list (SHAPE,,) 

— more properties will he nsed when objects start getting more 
complicated— 

Examplei The model ‘HOUSE 1 (see fig, ’HOUSE 1 } is written in this way; 
HOUSE 


(in its property list* finds) 

REGIONS ((A* {NEIGHBOR B*> {.NEIGHBOR C*) (SHAPE PENTAGON) 

(B* (NEIGHBOR A*) (NEIGHBOR C*) (SHAPE PARALLELOGRAM) 

(C* (NEIGHBOR A*) (NEIGHBOR B*) (SHAPE PARALLELOGRAM)) ) 



PIC* 1 HOUSE 1 * - A model* 


Ifhat this list means is that HOUSE is composed of three regions , 
namely A*, B* and C+j and that A* is neighbor of E* and C*, etc * 

More oner, it says the shapes of A* (pentagon), E* (parallel*jJinO 
and C* (parallelogram), Additional properties COuld be inserted herOn 
The names A+* E** etc*, given to tbe different faces, have no import¬ 
ance, they act as dummy variables (UAR or ’undefined 1 variables irt 
CONVERT^S* the names such as PARALLELOGRAM, PENTAGON etc*, given 
to the shapes* are crucial* since they are going to be compared by 
equality with the corresponding names in the property list of the 
regions of the scene* 

Note that the models we ere using are not "'categorical " - they don * t 
contain enough information (usually ) to reconstruct the object, 

liMamplc * - PYRAMID (see fig- 1 PYRAMID 1 ) * This model is written as 5 

(DEFPROP PYRAMID 
((A* (NEIGHBOR B*) 

(SHAPE TRIANGLE)) 

<B* (NEIGHBOR A*) 

(SHAPE TRIANGLE))) REGIONS) 


but also see figure 'PVJtWll 1 
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FIG. 'PYRAMID 

The following entiTnples of models will show in general how to build or 
define models* 

(PUTFRrtp (QUOTE CYLINDER) 

(QUOTE ((A* (DlElGHftQR R*) (SHAPE ELLIPSE)) (R* (NEIGHBOR A*) 

(SHAPE (i C i p))))) 


(QUOTE REGIONS)) 


PIG* 1 CYLINDER' A Model. 


Remark: Note how we describe B*’s shape as 

(SHAPE (TCI D)), i,e., as (straight, convex, straight., concave). 


(DEFPROP HOLLOWCYLIKDER 

((A* (NEIGHBOR E*) (SHAPE ELLIPSE) ) 

<R* (NEIGHBOR A*) (NEIGHBOR C*) (SHAPE{ELLIPSE INSIDE ELLIFSE)) ) 
(C* (NEIGHBOR E*) (SHAPE (I C ID)) > ) REGIONS) 


FIG. 1 HOLLOWCYLIMDER 1 
A Hodel- 



(PUTEROP (QUOTE CUBE) (QUOTE) 

C(C* (NEIGHBOR E*> 

(NEIGHBOR D*> 

(5HAFE PARALLELOGRAM)) 

(D* (NEIGHBOR C*> 

(NEIGHBOR E») 

(SHAPE PARALLELOGRAM)) 

(E ft (NEIGHBOR D«) 

(NEIGHBOR C* ) (SHAPE PARALLELOGRAM) ) )) 

(QUOTE REGIONS)) 


FIG. 'CUBE' A Model, 

It is really a parallelepiped. 


(DEFFROF HOLLOWHRICKJ 

( (D* (NEIGHBOR E*) (NEIGHBOR ?*)(NEIGHBOR G*)(HEIGHBOR H*) 
(SHAPE (PARALLELOGRAM IMSIDR PARALLELOGRAM)) ) 

(E* (NEIGHBOR U*) (NEIGHBOR F*} (SHAPE TRAFEZ) ) 

(F* (NEIGHBOR E*) (NEIGHBOR D+) (SHAPE TRAFEZ) > 

(G* (NEIGHBOR D*) (NEIGHBOR H*> (SHAPE PARALLELOGRAM)) 

(H* (NEIGHBOR D*) (NEIGHBOR G*) (SHAPE PARALLELOGRAM)) ) 

REGIONS) 



FIG, 


HOLLOWBRICK.' . 
A Medal, 



This page is 
missing from 
the original 
document. 
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HIE RESULTS 


We will present now severe] examples of scenes analyzed by DT> the 
program, in the PUP-6 computer. The symbol marks the Lines typed 
by the user* 


a 


# 


* 

# 

if 


$ 


a 


* 


COHV U 


(OREAD DT LISP 5 tq +W) 


(CREAD EX2 LISP tQ i*0 


(DREAD M0D2 LISP -tQ W] (IOC V> 

(v) 

(DT (QUOTE CUBE) (QUOTE EX2}) 

(CUBE 1. IS (A B C» 

(CUBE 2 . IS (J 1 11 }) 

(H FCH lEHOIfj 1ST U Vffl 

(Ut (QUOTE CYLINDER) {QUOTE EX2}) 

(CYLINDER 1 , IS (E D)) 

(CYLINDER 2. is (G F)> 
(AlCUJUBBOPQRfirllV 


Bring the CONVERT processor 

from t-apO ^ . 

Load the file containing. DT* 
the recognizer. 

faring the scene EX2 into 
meciory, (see fig. r EJi2'). 

Load the models* 

Look for 'CUBIs' in'EXZ'. 
(See fig. 'EX.2 1 ) . 

2 cubes are found. 

Y Z) Remaining of scene. 

Look for cylinders (see fig. 
‘CYLINDER 1 )■ 

W X Y ?■) ^remaining of scene. 


(DT (QUOTE HOLLOWCYLIHIlKR) (QUOTE EX 2 )) 

(HOLLOWCYLINLER 1. IS (TUS)) 

(ABCDEFGHIJKLHNOPQRVWXYa) 

(DT {QUOTE HQLLOWRRICR) (QUOTE EX 2 )> 

(HOLLOOERICK 1* TS (N 0 P q R)) ^aee fig. 1 EiOLLOOERLCK'. 

(A E C H F G H I J KL H ST UV H Y 1 ) 


Since we st-c tiT-cd to write 'QUqTg 1 ,, we define DD: 

# (DEFPROP DD (LAMBDA (A) (W (CAR A) (GADK A))) FEXPR) 

DD 

# (DD HOLLOWSRldt EX2) Compare with above. 

(HOLLOWBRICR 1. is (K 0 P Q R}> 

(A E C D ! F C H I J 1 L H S TI) Y If X Y 2) Good. Let oS see some thing 

else. 
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Now we begin to examine the scene FI01 (see fig. ’FIGl 1 ). 

In this figure we ere going to look for the presence of the following 
objects; CUBES, CYLINDERS, PYRAMIDS, HOLUWCYLIKDEfc, HGLLGWBRICKs. 
(Sec figures corresponding to those models). 


it $$ Out of TEOO 

£ 4$ 

f CQNV 4 

f (DREAD EX4 I.ISP 5) 

5 

it tq 

FIGl 

A 

E 

0 tWtV (DREAD DT LISP) load program (recognizer) 

5 

tf +Q 

EQUAL* 

S FRltftY (UREaD EX3 LISP) Load models 

5 

tQ 

QV 

# c (a* mv 

H tvt (QUOTE CUBE) (QUOTE FIGl)) Look for CUBEe In FIGl. 

(CUBE 1 IS (A B C» 

(CUBE 2 IS (J K l)} 

(DEFGHIMNOP&) 

ft (DT (QUOTE PYRAMID > (QUOTE STG1)) 

(PYRAMID l is (F G)} 2 pyramids are found, 

(PYRAMID 2 IS (If I)) (see also fig, " FTRAKl 0 * ) , 

(AB CDEJK1H80FZ) 

ft (DT (QUOTE CYLINDER) (QUOTE FIGl)) 

(CYLINDER 1 IS (D E)) Cylinder D E is located,. 

(AKFGH1JKLMI0PZ) 

ft (DT (QUOTE HOLLOWCYLINDER) [QUOTE FIGl)) 

(AECDEFGH IJKLMNQFZ) No hollowcylindfcts are 

P res enc, 

# (DT (QUOTE HQLLOfflJRICK) (QUOTE FIGl)) 

(ABCDEFGiJ I JKLOOM) DP could not find any NOLLOUERICK 

(see fig, T EE0LL0W1RICK 1 ) in scene 
PTGJ (see fig. f FIGl r ). 


GO to CONVERT 
load scene 


ft (mCEWF) 
it 1$ 


Go back to MACDMP and tape 1. 



This page is 
missing from 
the original 
document. 
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lflu analyze now FIG2 (sea fig. 'FIG2"). 


f 


(0D PYRAMID FIG2) 
{PYRAMID 1 is [L H)) 


Looking far PYRAMIDS 

(a Us model in fig, T ?YRAMID') 


CPYRAMID 2 is (X T)) 

(AECDEFGHIJKNORQRSTUVUZ) 


Note that pyramid LHC is not reported as such, but only L M ia 
reporEed or recognized. VThy i$ this? fiac.au.sa the modal "PYRAMID’ 
(see fig. "PYRAMID 1 ) is composed of two triangles. Also, it is in 
the nature of our algorithm that L H prevents recognizing M N. 

In OTder to get L H N* wt define PYRAMl as a pyramid which has 
three visible triangular fates; 


S (DEFFRCP PYRAMl 

H ((A* (NEIGHBOR fi*> (SHAPE TRIANGLE)) 

H (B a (NEIGHBOR A*) (NEIGHBOR C*) (SHAPE TRIABCLE)) 

# (C* (NEIGHBOR B*> (SHAPE TRIANGLE)) ) R&ClQNS) 

PYRAMl 

See fig, 'PYRAMl'. 

Now we apply this modal to scene FIG2; 

* (DO PYRAMl FIG2) 

(PYRAMl 1 IS (L M N)) Aja, Only 1 is found.Correct 

(ABGDEFGH IJ K 0 P u 3T n V V I n) (only one pyramid with three 

visible faces is present in 

FIG2) 

What wo really want is to define a pyramid aa something which 
shows either two or three triangular facesi so* 


£ (DEFFROF FYR (OR PYRAMID PYRAMl) REGIONS) 

PYR -- the last model, FYRAHl In 

this case, is searched first-- 


Note the use of the OR in a model. 

At this moment, FYR is a medel which stands for either 


4 ) “ ^ 
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(DD PYR FIG2) 

{PTRAM1 is (L M H» 

(PYRAMID l IS (X Y)} 

(ABCDEFCHIJK. QFQltSTUVWZ) 

KhaC would have happened if -we define PYR in the tmtGC order? 
Let ns define 


Good. 2 objects were found 
to match with PYft: (L H N> 
AND (XY), (see- fig. ’FIC2 1 ) 


# (DEFPROP PYR (OR, PYRAM1 PYRAMID) REGIONS)) 
PYR 


The last model in OR list, PYRAMID in this case* is searched first* 
The answer is: 

tf (DD PYR FIG2) 

(PYRAMID 1 IS £L H)) 

(PYRAMID 2 IS (ST)) 

(ARCDEFGHIJKNOPQRS 


Two objects matched with 
PYRAMID: (X Y) and (L M) ; 
after this,, no object was 
found to match with PYRAM1 


Conclusion: Order in the models Is Important 5 so ton# as we 
Inave things to the normal CONVERT matching aIgor1than 


HI 

* 




m PYR PM3> 

NIL 


FIG3 is an empty scene H 


(DO CYLINDER FIG2) 

(ABDDEFGHIJKLMNOFQRETnVVXTS) 


(DD CUBE FTC2) 

(CUBE 1 IS (I J X)) PIG2 contains 

(ABCDEFGFLMNOPQRSTUV M D S B Y C ^ 0 ' 


No cylinders. 
Cylinder P 0 
is partially 
occulted, so Is 
not found. 


Jf (DD ANGLE FIG2) 

(ANGLE 1 Is (D ABC)) 

(EFGHIJKLHNOPQRSTVVWXYZ) 

Angle Is a model described in the next page (see fig. ’ANCLE 1 ). 
Angle q V R T U was not found because has a different form (its 
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two dimensional projection has a different topology from model 
’ANGLE 1 ; namely has 5 faces or regions and nodal ’ANGLE 1 has only 

4>* 

Angle E F G H was not found because it is partially occulted. 

$ (ED SPHERE FTG2) 

(SPHERE 1 is <S>) Tuo spheres in FlG2, r 

(SPHERE 2 is (W)) 

(A » C H E F C H 1 J U H N O E (J R I 1‘ H Y J) 

W ?? This is a surprise: Lot us see what kind cf region W is; 

$ (GET (QUOTE W) (QUOTE HEIGHBOR)) 

NIL 

(GET (QUOTE W) (QUOTE SHAPE)) 

NIL 

Aja’ H has no neighbors* and has no ahape. Why doea it match 
(SHAPE CIRCLE)? (see fig. 'FIG2'). There ia no region named W + 

This was an error in the data; Instead o£ 

(DEFPRDP FIG2 (A E G D E F G HI J U H K O ? () R S T H W H !) EEGIONS) 
we should have said; 

(&EFPROP FTG2 (ABCDEFGHI.TKLXNOPQRSTIiVXYZ) EEGIONS) 
(DEFPROP ANGLE 

((A* (NEIGHBOR B*) (SHAPE FUNNY)) 

(B* (NEIGHBOR A*) (NEIGHBOR C*) (NEIGHBOR D*) (SHAPE ELE)) 

(C* (NEIGHBOR B*) (NEIGHBOR H*> (SHAPE PARALLELOGRAM)) 

(D+ (NEIGHBOR B*) (NEIGHBOR C*) (SHAPE PARALLELOGRAM)) ) 

REGIONS) 



This page is 
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TILE PROGRAM 

The results just presented were obtained in the PDF-6 computer, using 

( 7 ) 

the CONVERT s * processor, Tlii$ last is imbebbed in LISP, 

DT ts the main function, it Lias two arguments i the scene and the model, 

DT handles the (OR feature, constructs a CONVERT pattern from 

the given model and calls to the CONVERT processor to deal with it. DT, 
therefore, works much in the way of a compiler, transforming a MODEL 
into a PATTERN; in this form, we avoid the double scanning that would 
originate if we look at the model in order to understand what does it 
require, then look at the scene to try to meet the requirement; once 
done this, come back to the model to see what else is necessary; go 
again to the scene to look for that feature etc. 

(9) 

There is n marked similarity between DT and TD , and the reader 

19 ) 

is referred to the report on TD, which talks in detail the way the 
generated pattern drives the match and the search. See also appendix. 

The program is; 

(DEFPROP DT(LAMBDA (MODEL SCENE) (COND 

((AND (COND ((ATOM SCENE) (5ETQ SCENE 

(GET SCENE (QUOTE REGIONS) »> (T NIL) ) MIL)MIL) 

((AND 

(ATOM MODEL) (SETQ V MODEL) 

(NULL (SETQ MODEL (GET MODEL (QUOTE REGIONS)))) )SCENE) 

((EG (CAR MODEL) (QUOTE OR)) (COND (NULL (CDR MODEL)) SCENE) 

(T (DT (CADR MODEL) (DT (CONS (CAR MODEL) (CDLR MODEL)) SCENE))) 
))((DKFPEOP mi (0) PEG EXP ) 

(CONVERT (APPEND ( PREPARE MODEL) 

(QU (\C PAT (EV (CONSTRUCT MODEL)) 

MODEL EXPR (EV W) 

SCENE 

EKPR 

(EV SCKMR ))) 
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(QUOTE < \R UAR NIL 

USED EU\ r ==■ 

HUM S m, C-SET<r MUM (-INCR- Nil))))) 

NIL 

SCENE 

(QUOTE (Cl (C C (-FIDO MIL 

(-PMIT- (MODEL NUM IS USED)) 

(•SOTL* SCENE 
EKPR 

(-CDMP* SCENE USED) 

(*TiETN- (“REPT= SCESE Cl) 

)) >>>)>>))) 

EKPR) 

The dictionary M of CONVERT (5 incensed with (PREPARE A), where A is 
the model. A pattern Is generated from, the model with the help of 
(CONSTRUCT A), and then fa baptised with the name /C. 

The 4th argument of CONVERT consists only of one set of rules. 

Cl, With Ortly one rule which says: 

[/C {-PROG - () 

(■FKJIT- (MODEL NUM IS USED)) 

(-gREL- SCEKE EXRR (-COMP- SCESE USED) 

(-REIN* (*JSEPT- SCENE Cl)) ))] 

" r If a match is found between the scene and /C (/C Is the generated 
pattern) h print '(MODEL NUM IS USED) f , for Instance, (CURE 5 IS (A B C>) 
Tt'hind SCENE Co the re-ialnlng of the SCENE --the complement of SCENE 
and (A D C) —; and remits over this again.' 1 The ^PRDG-ram feature is 
explained In (&]. 

Wo will see nw the auxiliary functions. 
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(PREPARE A) 

(DEFPROP PREPARE (LAMBDA (A) 

(COND ((NULL A)NIL) 

(T (CONS (CAAR A) 

(CONS (QUOTE PAV) 

(CONS (CONS (QUOTE -AND-) 

(MAPCAR (FUNCTION (LAMBDA (U) 

(QU (-XEC- 

(COMPARE (EV (APPEND U (LIST (LIST (QUOTE -QUOT-) (CADR U))))) 

=SAME= )))) (CDAR A))) 

(PREPARE (CDR A))))))))EXPR) 


Explanation.- If 

MODEL = ( (A* (NEIGHBOR B*) (NEIGHBOR C*) (SHAPE TRIANGLE)) 
(B* ( ... ) ( ... ) ( ... )) 

. ) 


then 


(PREPARE A) 


(A* PAV (-AND- (-XEC- COMPARE (NEIGHBOR B* (-QUOT-B*)) -SAME-) 
(-XEC- COMPARE (NEIGHBOR C* (-QUOT-C*)) -SAME-) 
(-XEC- COMPARE (SHAPE TRIANGLE (-QUOT- TRIANGLE)) 

-SAME-)) 


B* PAV (-AND- (-XEC- ...) (-XEC- ...)) 


) 


(DEFPROP EQUAL *(LAMBDA (A B) (OR (NULL B) (EQUAL A B)) ) EXPR) 

(CONSTRUCT A) 

(DEFPROP CONSTRUCT (LAMBDA (A) 

(LIST (QUOTE -UNO- 

(NCONC (MAPCAR (FUNCTION (LAMBDA (B) (QU (-AND- (EV (CAR B))USED))))A) 

(QUOTE (—))))) EXPR) 

(CONSTRUCT MODEL)- (-UNO- ((-AND- A* USED) (-AND- B* USED) (-AND- C* USED)—)) 
(COMPARE A B) 

A has the form (NEIGHBOR B* (-QUOT- B*)) 

OR (SHAPE TRIANGLE (-QUOT- TRIANGLE)) 

B has the form D5 

OR N (is the name of a region of the scene). 
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(DEFRRQP COMPARE (LAMBDA (A E) 

(COBD {(EQ (CAR A) (QUOTE NEIGHBOR)) (OR (EQ (CADR A}{CADDR A)) 

(MEMBER (CADR A)(GET B(CAR A))))) 
(T (EQUAL* (CADR A) (CRT E (CAR A))))» EXPR) 


value 


flf (car A) 


Le 


thervise 


- NEIGHBOR 


f 

{ 


T if [cadi A) - (caddr A) 


otherwise 


fT if (cadr A) 
otlierwise- 


i£ & is empty 
EQUAL A B} otherwise 


—region not yet found- 
(list of neighbors of B) 


(qu A) 

QU quotes lta argument. Quotes all the elements of its argument, 
eKtept those which have (EV .in front o£ it. For instance, if 
A ■ 35» E = 36* then 

(QU (ABB (EV Bl O (( C A H 0 t E 5}} ((A (EV A) C (EV A> )) 59 )) is 

(ABB 36 O (( C U 0 I E &» (( A 35 C 35 » 59 )). 


(EEFRROF QU (LAMBDA (A L) 

(COND ((ATOM (CAR A>)(CAR A)) 

((EQ (CAAR A) (QUOTE EV))(EVAL (CAEAR A)Li) 

(T (?£APCAR (FUNCTION (LAMBDA (K) 

(EVAL (LI$T (QUOTE QU) 
it) 

(CARA))}}) X))) 


FEXPR) 

Those are all the functions wfi need. 
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APPENDIX 

IQWREERED patterns in convert 

A UNO (FI P2 .,.Pn) A Is an atom (not a fragment) in the 

mode UNO; the A^ ate patterns 
(exp rose ions, not fragments). 

A will match vith ati expression E if at least one of the patterns P^ matches 
uith such an E. That feeing the case^ the successful pattern is removed From 
the associated expression In the dictionary and this entry in the dictionary 
becomes 

A UNO (Pi F 2 ,.P, . P., t D , 

1-1 1+-1 , , - Pn) 

Therefore,, if several A r s occur in a pattern, each one represents a different 
Pi to be matched * 


Example; If A la defined in the dictionary as A i"NO (1 4 2) , then a pattern 
such as (KAMA A) will match: (K 4 M U) 

and <K 1 X 2 4> 

and (K 1 X 4 2 ) 

will not match (K L H 1 2) 

or (E 1 M 4 J) 

or (K 4 J 2 M) 


and the pattern (A A. A A) util not esateh anything„ sine* A has only 3 
patterns available in the associated expression (in the dictionary), and 
(A A A A) requires 4. 

Compare with =0K= 

_ pattern _ 

X is {K A M "A AT] 


expression dictionary 


E ) 

L ^ 

A UNO (1 4 2) 

A FAT ("DR* 142) 

if 


Is a match obtained? 

Is a match obtained? 

(K 4 M .1 2) 


yes 

yes 

(K 1 M 2 4) 


yOs 

yes 

(K 1 M 4 2) 


yes 

yes 

(K 1 H 1 2 ) 


no 

yes 

(U H 4 3} 


fid 

no 

(nun) 


no 

yes 

<K 1X242) 


np 

no 
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{-IHO- (PL P2 ... Pn)) The are (expression) patterns. 

This pattern will match a List E having n elements if there exists a 
permutation of {Fl ?2 . .. Pn) which catches E, 

- (-I ■? ,,, Pn ===>) The P^ (i = are (expression) 

patterns. The last p is the symbol 
Tills pattern will match a list E having m n elements, if E contains 
n elements , ... ^ such that a permutation of (PI F2 ... Pn) matches 

<e l e 2 -"V* 

Example: (-UH0" (145)) will aateh {1 4 5), (5 4 1) t but not (144), 

(5 1 1), (i 4 6), (1455). 


expression 

_ 

pattern X 

(•UNO- (1 4 5)) 

(=UNO (1 4 5 =)) 


is a match obtained? 

Is a match obtained? 

(1 4 5) 

yea 

yes 

(5 4 1) 

yes 

yes 

(1 4 4) 

no 

no 

(5 1 1) 

no 

no 

(1 4 6) 

no 

no 

(1455) 

no 

yes 

(4 16 5) 

no- 

yes 

(1234) 

ho 

no 

(1 2 3 4 5) 

no 

yes 

(A B C} 

no 

he 


}Jote that in £=UN0— L), L is a list whose elements are considered to he 
patterns (expressions) to be matched against the elements of E, which is 
assumed to be a List* Therefore, a pattern like (-UNO- <=AXD= A B C)) 
will catch with 3 list having the 4 atoms -AND-, A, U and C In any order 
(we are assuming ah empty dictionary); in other words f (-AND= A L C), and 
:or tills ease any other similar list. Is not interpreted as a pattern by =UNO. 


(■"ITH'O*' i.) ititarprets its argument L as a list of patters (without 
■or-d3 ■» The only exception is the following:: 

(=CTNO x: <=GEN= S)) S ^ a skeleton. 

5) promotes a replacement 

on it f and the result* assumed to be a list, is treated as an 
unardered pattern* which may or nay not have the === at the end. 
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EXAMPLES OF UKORDEI1ED PATTERNS. 


NIL moans failure fno mutch) ; 

Something else ft he dictionary 5 rxans a ciatch did -occur. 


&t art 

V 2130.0 

rosomblef { =unO- {a b c)) (* * *) (a be)) 
f* * *) 

resemblef f=Ltno= [a b c C^nno- (12 3)) d e)) (* * *) (d e (I 3 2) b a c)) 
(* * *) 

resemblef f=uno= (a be)) f* * *) (a b c d)) 

NIL 

feserablef (=uno= f=ato= =mjni= =mo=)) (* * *) (14 a)) 

( + + *) 

resemblef f=uno= (k y a)) (it pav -tuim- y pav “aCo* e yar ()) [ (a) 3 <1a)) 

(2 VAR (A) V VAR AA T FAT -ATO* VAR AA J£ VAE 3 K FAT -NUtt- 
K VAF 3 K PAV -1JUM- Y PAV -ATO* Z LIAR NIL) 

resemble( (-uno- (a b c -*-)) (* * *) (1 2 3 b 4 a 5 6 c 7)) 
f+ A +) 

resemblef (-u.no- (a b c =-=)) (***) (1 2 j 3 b 4 3 5 5 l & a H a)] 


resemblef (@ a a) (a imo (123)) (123)) 

(A UNO NIL A UNO <3) A UNO (2 3) A ONG (1 2 3)) 

resemblef fa a b a) fa vno (1 2 3)) (2 3 b 1)) 

(A UNO NIL A UNO <1) A UFO (1 3) A UNO (1 23)) 

resemblef (a a a a) fa uno (123)) (1321)) 

NIL 

resemblef (a a a a) fa yn<j (1 2 3)) (1 2 3>) 

NIL 

regefflbie( ft a a a) fa urtG (1 2 -ato-)} (b 2 fi 1)) 

(A ONO NIL A ONO (1) A UNO (1 '•ATT)-) A UNO (1 1 =ATO-)> 
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reseable( (a i a a) (a upo (12 3)) (12 3 1)) 

tail, 

resemble( (a a a a) (a pat (=or= I 2 3)) (1 2 3 1)) 

(A PAT (-0R- 1 2 3)> 

resemble { (a b a) (a uno {1 2)) (2 b 1)} 

(A Dm ML A UNO (1) A UNO (1 2)) 

reat^blc( (a b a) (a uno (1 2)) (b 2 a)) 

NIL 

resemble ( (=utio- (a b a)) (a pat (=or= 1 £)) (2 b I)> 

(A PAT (-OR 1 * 1 2)) 

reaetab 1 a( (“Litio* (a b a)) (a pat (=or= 1 2)) (b 2 a)) 
EIL 

Tcaeable ( (-Liti&- (a b &)) (a pat {=or= 12)) (b 2 1)) 
(A PAT (--OR- 12)) 

Teaecible ( (aba) (n (L 2)) (b 2 1)) 

ML 



